An agent-based framework for auditory-visual speech investigation
نویسندگان
چکیده
This paper presents a framework for investigating the relationship between both the auditory and visual modalities in speech. This framework employs intentional agents to analyse multilinear bimodal representations of speech utterances in line with an extended computational phonological model.
منابع مشابه
Comparative Effect of Visual and Auditory Teaching Techniques on Retention of Word Stress patterns: A Case Study of English as a Foreign Language Curriculum in Iran
This study aimed at investigating the effect of visual (Cuisenaire Rods) and auditory nonsensical monosyllables using Pratt speech processing software as teaching techniques on retention of word stress. To this end, 60 high school participants made the two experimental groups of the study each having 30 students on the basis of their proficiency scores on KET (Key English Test). In one experime...
متن کاملText-to-audio-visual speech synthesis based on parameter generation from HMM
This paper describes a technique for synthesizing auditory speech and lip motion from an arbitrary given text. The technique is an extension of the visual speech synthesis technique based on an algorithm for parameter generation from HMM with dynamic features. Audio and visual features of each speech unit are modeled by a single HMM. Since both audio and visual parameters are generated simultan...
متن کاملنوروپاتی شنوایی در دو بیمار مبتلا به نوروپاتی عمومی: گزارش موردی
Background: Although it is not a new disorder, in recent times we have attained a greater understanding of auditory neuropathy (AN). In this type of hearing impairment, cochlear hair cells function but AN victims suffer from disordered neural transmission in the auditory pathway. The auditory neuropathy result profile often occurs as a part of that of the generalized neuropathic disorders, indi...
متن کاملمشکلات جداسازی اصوات گفتاری همزمان در کودکان کم شنوا
Objective: This study was a basic investigation of the ability of concurrent speech segregation in hearing impaired children. Concurrent segregation is one of the fundamental components of auditory scene analysis and plays an important role in speech perception. In the present study, we compared auditory late responses or ALRs between hearing impaired and normal children. Materials & Methods...
متن کاملNeural dynamics of audiovisual speech integration under variable listening conditions: an individual participant analysis
Speech perception engages both auditory and visual modalities. Limitations of traditional accuracy-only approaches in the investigation of audiovisual speech perception have motivated the use of new methodologies. In an audiovisual speech identification task, we utilized capacity (Townsend and Nozawa, 1995), a dynamic measure of efficiency, to quantify audiovisual integration. Capacity was used...
متن کامل